Audio control system and related methods

ABSTRACT

Some embodiments of the invention are directed to an audio production system which is more portable, less expensive, faster to set up, and simpler and easier to use than conventional audio production tools. An audio production system implemented in accordance with some embodiments of the invention may therefore be more accessible to the typical user, and easier and more enjoyable to use, than conventional audio production tools.

RELATED APPLICATIONS

This application is a continuation of commonly assigned InternationalApplication No. PCT/US2018/015655, filed Jan. 29, 2018, entitled “AudioControl System And Related Methods,” which claims priority to commonlyassigned U.S. Provisional Application Ser. No. 62/454,138, filed Feb. 3,2017, entitled “Audio Control System And Related Methods.” The entiretyof each of the applications listed above is incorporated herein byreference.

BACKGROUND INFORMATION

Audio production tools exist that enable users to produce high-qualityaudio. For example, some audio production tools include electronicdevices and/or computer software applications, and they enable users torecord one or more audio sources (e.g., vocals and/or speech captured bya microphone, music played with an instrument, etc.), process the audio(e.g., to master, mix, design, and/or otherwise manipulate the audio),and/or control its playback. Audio production tools may be used toproduce audio comprising music, speech, sound effects, and/or othersounds.

Computer-implemented audio production tools often provide a graphicaluser interface with which users may complete various production tasks onaudio source inputs, such as from a microphone or instrument. Forexample, some tools may receive audio input and generate one or moredigital representations of the input, which a user may manipulate, suchas to obtain desired audio output through filtering, equalization and/orother operations.

Conventional audio production tools often also enable a user to “map”audio source inputs to corresponding tracks. In this respect, a “track”is a component of an audio or video recording that is distinct fromother components of the recording. For example, the lead vocals for asong may be mapped to one track, the drums for the song may be mapped toanother track, the lead guitar may be mapped to yet another track, etc.In some situations (e.g., in live performances), multiple audio inputsmay be recorded at the same time and mapped to multiple correspondingtracks, while in other situations (e.g., in recording studios), thevarious audio inputs collectively comprising a body of audio may berecorded at different times and mapped to corresponding tracks.

BRIEF DESCRIPTION OF DRAWINGS

Various aspects and embodiments of the invention are described belowwith reference to the following figures. It should be appreciated thatthe figures are not necessarily drawn to scale. Items appearing inmultiple figures are indicated by the same reference number in all thefigures in which they appear.

FIG. 1A is a block diagram illustrating an audio controller of an audiorecording system, according to some non-limiting embodiments.

FIG. 1B is a block diagram illustrating a mobile device configured tooperate as part of an audio recording system, according to somenon-limiting embodiments.

FIG. 2 is a block diagram illustrating control inputs of the audiocontroller of FIG. 1A, according to some non-limiting embodiments.

FIG. 3 is a block diagram illustrating an audio recording system and acommunication network, according to some non-limiting embodiments.

FIG. 4A is a block diagram illustrating how multiple sequencesassociated with an audio input may be generated, according to somenon-limiting embodiments.

FIG. 4B is a schematic diagram illustrating transmissions of datasequences using the communication network of FIG. 3, according to somenon-limiting embodiments.

FIG. 5A is a flowchart illustrating a method for transmitting an audioinput to a mobile device, according to some non-limiting embodiments.

FIG. 5B is a flowchart illustrating a method for receiving an audioinput with a mobile device, according to some non-limiting embodiments.

FIG. 6A is a schematic diagram illustrating reception of a lowresolution (LR) sequence with a mobile device, according to somenon-limiting embodiments.

FIG. 6B is schematic diagram illustrating a mobile device displaying awaveform, according to some non-limiting embodiments.

FIG. 6C is a schematic diagram illustrating reception of a highresolution (HR) sequence with a mobile device, according to somenon-limiting embodiments.

FIG. 7A is a schematic diagram illustrating an example of a waveformdisplayed in a record mode, according to some non-limiting embodiments.

FIG. 7B is a schematic diagram illustrating an example of a waveformdisplayed in a play mode, according to some non-limiting embodiments.

FIG. 8A is a schematic diagram illustrating a mobile device configuredto receive gain and pan information, according to some non-limitingembodiments.

FIG. 8B is a table illustrating examples of gain and pan information,according to some non-limiting embodiments.

FIG. 8C is a block diagram illustrating an example of a stereo soundsystem, according to some non-limiting embodiments.

FIG. 8D is a flowchart illustrating a method for adjusting gain and pan,according to some non-limiting embodiments.

FIG. 9A is a schematic diagram illustrating a mobile device performing asound check routine, according to some non-limiting embodiments.

FIG. 9B is a schematic diagram illustrating an example of an audio inputreceived in a sound check routine, according to some non-limitingembodiments.

FIG. 9C is a schematic diagram illustrating an example of an audiooutput obtained from a sound check routine, according to somenon-limiting embodiments.

FIG. 9D is a flowchart illustrating a method for performing a soundcheck routine, according to some non-limiting embodiments.

FIG. 10 is a block diagram illustrating an audio recording system havinga plurality of amplification stages, according to some non-limitingembodiments.

FIG. 11A is a block diagram illustrating an audio recording systemhaving a track mapping controller, according to some non-limitingembodiments.

FIG. 11B is a flowchart illustrating a method for automatically mappingaudio inputs to tracks, according to some non-limiting embodiments.

FIG. 12 is a block diagram illustrating a computer system, according tosome non-limiting embodiments.

DETAILED DESCRIPTION

I. Overview

The Assignee has appreciated that, for a significant number of users,conventional audio production tools suffer from four main deficiencies.First, conventional audio production tools are expensive. In thisrespect, many audio production tools are designed (and priced) for useby professional audio engineers to produce audio for professionalmusicians, studios and/or other high-end users. As a result, these toolsare financially out of reach of many who may benefit from theirfeatures.

Second, producing audio using conventional audio production tools istime- and labor-intensive, and requires specialized expertise. As oneexample, mapping an audio recording to a corresponding track typicallyrequires a number of manual steps. For example, a user may be forced tofirst create the new track using a software program, and then manuallypair audio source input to the new track, and then ensure that the audioinput is being produced and captured in the manner needed to combine thetrack with other tracks. This process may then be repeated for eachadditional track. As a result of the time- and labor-intensive nature ofmany types of audio production tasks, many potential users arediscouraged from using conventional audio production tools.

Third, conventional audio production equipment is often bulky. Even whenthe tools used to process audio recordings are computer-implemented,other equipment involved in producing audio (e.g., sound productionequipment like amplifiers, sound capture equipment like microphones,sound recording equipment, etc.) is often cumbersome. As a result, manyusers may find it inconvenient or impractical to use conventional audioproduction tools in certain (e.g., space-constrained) settings, and/ormay be discouraged from producing audio at all if appropriate facilitiesare unavailable.

Fourth, functionality provided by conventional audio production tools isoften more advanced than the average user needs or wants. As a result,the expense, time and bulkiness associated with sophisticatedconventional audio production tools may not be worthwhile for manyaverage users.

Some embodiments of the invention overcome these and other deficienciesto provide an audio production system that is less expensive, faster toset up, simpler and easier to use, and more portable than conventionalaudio production tools. An audio production system implemented inaccordance with some embodiments of the invention may be more accessibleto the typical user, and easier and more enjoyable to use, thanconventional audio production tools.

In accordance with some embodiments of the invention, an audioproduction system comprises an audio controller that communicates with amobile device. In some embodiments, the audio controller may have arelatively small form-factor, which makes it portable and easy to use inany of numerous settings. For example, in some embodiments, the audiocontroller may be small enough to fit in a backpack or a purse. Theaudio controller may include easy-to-use controls for acquiring,recording and playing back audio. Further, as described in detail below,an audio controller implemented in accordance with some embodiments mayenable a user to quickly and easily create multiple tracks, stop andstart recordings, discern that audio is being recorded at appropriatelevels, and perform other audio production-related tasks.

In some embodiments, an audio controller and mobile device maycommunicate wirelessly, enabling various features of the mobile deviceto be employed to perform audio production tasks seamlessly. Forexample, the mobile device's graphical user interface may be used topresent controls that a user may employ to process audio that iscaptured by the audio controller. The mobile device's graphical userinterface may enable a user to mix, cut, filter, amplify, equalize orplay back captured audio. Recorded tracks may, for example, be stored inthe memory of the mobile device and be accessed for processing by a userat his/her convenience.

A graphical user interface of the mobile device may also, oralternatively, be used to provide visual feedback to a user while audioinput is being captured by the audio controller, so that the user maygain confidence that audio being captured by the audio controller hasany of numerous characteristics. For example, in some embodiments, thegraphical user interface of the mobile device may display a waveformand/or other representation which visually represents to the user thegain level of the audio being captured by the audio controller, so thatthe user may be provided with visual feedback that the audio beingcaptured by the audio controller has a suitable gain level. For example,the visual feedback may indicate that the gain level of the capturedaudio is within a suitable dynamic range, and/or has any other suitablecharacteristic(s).

In this respect, the Assignee has appreciated that the usefulness ofsuch visual feedback is directly correlated to the visual feedback beingpresented to the user in real time or near real time (and indeed, thatvisual feedback which is delayed may confuse or frustrate the user). TheAssignee has also appreciated, however, that wireless communication iscommonly prone to delays and interruptions, particularly when largeamounts of data are being transferred. As a result, some embodiments ofthe invention are directed to techniques for wireless communicationbetween an audio controller and mobile device to enable visual feedbackto be presented to the user in real time or near real time.

Given that a digitized version of captured audio may comprise largeamounts of data, which may prove difficult to transmit from the audiocontroller to the mobile device in real time or near real time, someembodiments of the invention provide techniques for generatinginformation that is useful for rendering a visual representation ofcaptured audio, communicating this information to the mobile device inreal time or near real time, and separately producing and latercommunicating a digitized version of the audio itself. As such, in someembodiments, data that is used to render a visual representation of anaudio recording to the user via the mobile device may be decoupled fromthe digitized version of the audio, and transmitted separately from thedigitized version of the audio to the mobile device, so that it may bedelivered to the mobile device more quickly than the digitized versionof the audio.

Such a transfer of information may be performed in any of numerous ways.In some embodiments, both the data useful for rendering the visualrepresentation, and the digitized version of the audio recording, may begenerated based on the same audio input, as it is captured by the audiocontroller. For example, in some embodiments, two distinct datasequences may be generated from captured audio. A first sequence,referred to herein as a “low-resolution (LR) sequence”, may be generatedby sampling a body of audio input at a first sampling rate. The samplingrate may, for example, be chosen so as to provide a sufficient number ofdata samples so that one or more representations (e.g., waveforms, barmeters, and/or any other suitable representations) may be rendered onthe mobile device, but a small enough number of samples so that wheneach sample is sent to the mobile device, the transmission is unlikelyto encounter delays due to latency or lack of bandwidth in thecommunication network. A second sequence, referred to herein as a“high-resolution (HR) sequence”, may, for example, be generated bysampling the body of audio input at a second sampling rate which isgreater than the first sampling rate. In some embodiments, the HRsequence may comprise a high-quality digitized version of the capturedaudio input which is suitable for playback and/or subsequent processingby the user. In some embodiments, the LR and HR sequences may be sent tothe mobile device in a manner that enables the LR sequences to bereceived at the mobile device in real time or near real time, so thatthe visual representation of the captured audio may be renderedimmediately, when the user finds it most useful. By contrast, the HRsequences may be received at the mobile device later, and indeed may notarrive at the mobile device until after the user stops recording audiowith the audio controller, when the user is most likely to be ready totake on the task of playing back and/or processing the audio. Sendingdata useful for rendering the representation separately from thedigitized version of captured audio may be accomplished in any ofnumerous ways, such as by assigning transmissions of LR sequences ahigher priority than transmissions of HR sequences, by transmitting HRsequences less frequently than LR sequences, and/or using any othersuitable technique(s). As a result, some embodiments of the inventionmay prevent the transmission of a digitized version of captured audiofrom interfering with the timely transmission of data useful forrendering a representation on the mobile device.

Some embodiments of the invention enable users to perform certain audioproduction tasks more easily than conventional audio production toolsallow. As one example, some embodiments may enable a user toautomatically map a new audio input to a new track. For example, when anew audio input is received, some embodiments of the invention mayautomatically create a new track for the input, and map the input to thenew track. As such, users may avoid the manual, time-intensive processinvolved in creating a new track using conventional audio productiontools.

As another example, some embodiments of the invention may providecontrols that enable a user to more easily adjust the gain and panlevels of recorded audio than conventional audio production tools allow.(In this respect, the gain level for recorded audio generallycharacterizes the power level of a signal representing the recordedaudio as compared to a predetermined level, and the pan level generallycharacterizes the amount of a signal representing the recorded audiothat is sent to each of multiple (e.g., left and right) channels.) Insome embodiments of the invention, the graphical user interface of themobile device may enable a user to easily specify both the gain leveland the pan level for recorded audio using a single control and/or via asingle input operation. For example, in some embodiments, the userinterface may include a touchscreen configured to receive gain/pan datafor each track of a multi-track recording, via a cursor provided foreach track. The touchscreen may, in some embodiments, represent the gainand pan levels for each track on an X-Y coordinate system, with the gainlevel represented on one of the X-axis and the Y-axis, and the pan levelrepresented on the other of the two axes. By enabling a user to move acursor up/down/left/right within the coordinate system shown on thetouchscreen, some embodiments may provide for easy user adjustment ofthe gain and pan for tracks in a recording.

As another example, some embodiments of the invention may providecontrols which enable a user to more easily perform a “sound check” forrecorded audio than conventional audio production tools allow. In thisrespect, sound checks are conventionally performed in audio recording orlive performance settings to make sure that the sound being produced ata sufficiently high gain level to enable it to be heard clearly, but atnot such a high gain level that captured sound becomes distorted. Usingconventional audio production tools, performing a sound check is acumbersome process. For example, a user may play a portion of a musicpiece, check the gain level of the captured audio, adjust the gain levelif it is not at the desired level, then play a portion of the musicpiece again, then re-check whether the gain level is appropriate, and soon until the right level is achieved. This is not only unnecessarilytime-consuming, but can also be complicated and error-prone if someportions of the music piece are louder than others. Accordingly, someembodiments of the invention enable a user to perform a sound checkroutine automatically, such as in response to audio input beinginitially captured. For example, in some embodiments, when the userfirst begins creating sound, one or more components of the audiorecording system may automatically detect one or more characteristics ofthe sound, and automatically adjust the gain level of captured audio sothat it falls within a predetermined acceptable dynamic range.

It should be appreciated that the foregoing is a non-limiting overviewof only certain aspects of the invention. Some embodiments of theinvention are described in further detail in the sections that follow.

II. Audio Production System

FIGS. 1A-1B depict components of a representative audio recordingsystem, according to some embodiments of the invention. In particular,FIG. 1A illustrates a representative audio controller 102 and FIG. 1Billustrates a representative mobile device 152. In the example shown,representative audio controller 102 comprises a plurality of audio inputports 104 ₁, 104 ₂ . . . 104 _(N), a processor 106, a memory 112,control inputs 108, amplifier 109, audio output port 110, transceiver114, visual output unit 116, and power unit 118. The audio input ports104 ₁, 104 ₂ . . . 104 _(N) may, for example, be connected to differentaudio sources, such as different instruments or microphones. Of course,some embodiments of the invention may not provide multiple audio inputports, as any suitable number may be provided. In some embodiments, easyaccess to one or more of the audio input ports may be provided byplacing the audio input ports on the external housing of the audiocontroller.

In some embodiments, the audio controller may be equipped with amicrophone, which may be connected to an audio input port. Themicrophone may, for example, reside within the audio controller'shousing. Additionally, or alternatively, external microphones may beused. The audio input ports 104 ₁, 104 ₂ . . . 104 _(N) may receiveaudio inputs from one or more audio sources. An audio input may, forexample, be time-delimited, such that it consists of sound capturedduring a particular time period. The time period may be fixed orvariable, and be of any suitable length. Of course, an audio input neednot be time-delimited, and may be delimited in any suitable fashion. Forexample, a user may cause the generation of a time-delimited audio inputby creating audio during a certain time interval, such as between thetime when the user actuates a “record” button and the time when the useractuates a “stop” button. The audio input(s) may be provided toprocessor 106. Processor 106 may be implemented using a microprocessor,a microcontroller, an application specific integrated circuit (ASIC), afield programmable gate array (FPGA), or any other suitable type ofdigital and/or analog circuitry. Processor 106 may be used to sample theaudio inputs to digitize them. In addition, processor 106 may beconfigured to process the audio inputs in any suitable manner (e.g., tofilter, equalize, amplify, or attenuate). For example, processor 106 mayexecute instructions to analyze the spectral content of audio input anddetermine whether such spectral content has a suitable distribution.Such instructions may, for example, produce a filter function aimed atfiltering out certain spectral components of the audio input (e.g.,providing a high-pass filter response, a low-pass filter response, aband-pass filter response and/or a stop-band filter response). Suchinstructions may also, or alternatively, balance the spectral content ofthe audio input by attenuating and/or amplifying certain spectralcomponents with respect to others. For example, such instruction may beused to produce spectral equalization. Such instructions may also, oralternatively, analyze one or more levels of the audio input anddetermine the suitability of the level(s) for the desiredrecording/playback environment, and/or amplify or attenuate the level(s)if desired.

Processor 106 may be coupled to memory 112. Memory 112 may have anysuitable size, and may be implemented using any suitable type of memorytechnology, including random access memory (RAM), read only memory(ROM), Flash memory, electrically erasable programmable read only memory(EEPROM), etc. Memory 112 may be configured to store audio inputsreceived through the audio input ports, and/or to store modifiedversions of the audio inputs. In some embodiments, as it will bedescribed further below, a portion of memory 112 may be used to bufferdata to be transmitted to mobile device 152.

Processor 106 may be coupled to audio output port 110. In someembodiments, processor 106 may be coupled to audio output port 110through amplifier 109. Audio output port 110 may be connected to a soundemitting device, such as a speaker set or a headphone set. The speakerset may be integrated with audio controller 102. For example, thespeaker may be mounted in the housing of audio controller 102.Alternatively, or additionally, the speaker may be external. Processor106 may comprise circuitry for driving the audio emitting deviceconnected to audio output port 110. For example, processor 106 maycomprise a digital-to-analog converter. Amplifier 109 may be used toadjust the level of the audio output as desired.

Processor 106 may be coupled to control inputs 108. Some representativecontrol inputs 108 are shown in FIG. 2. Control inputs 108 may compriseany suitable user interface, including physical buttons, touch screencontrols, and/or any other suitable control(s). It should be appreciatedthat control inputs 108 need not be manually actuated. For example, insome embodiments, control inputs 108 may be actuated via voicerecognition.

In the example shown in FIG. 2, control inputs 108 comprise a “record”button 202. When the record button is actuated by a user, the audiocontroller 102 may begin to record an audio input. The record button maybe configured to record any suitable number of audio inputs. In theexample shown, control inputs 108 also comprise “play” button 204. Whenthe play button is actuated by a user, the audio controller 102 may playa recorded audio input using audio output port 110, which may beconnected to a speaker set or a headphone set. In the example shown,control inputs 108 may comprise a “stop” button 206. When the stopbutton is actuated by a user, the audio controller 102 may stoprecording if recording is underway or stop playing if playing isunderway. In the example shown, control inputs 108 comprises a “createproject” button 208. When the create project button is actuated by auser, processor 106 may allocate a portion of memory 112 for a newproject. The portion of the memory 112 may be populated with one or moreaudio inputs that are considered by the user as part of the sameproject.

In the example shown, control inputs 108 comprise a “sound check” button210. When the sound check button is actuated by a user, the audiocontroller 102 may initiate a sound check routine. Sound check routineswill be described further below. In the example shown, control inputs108 comprise an “audio output level” button 212. The audio output levelmay be used to increase or decrease the level of the audio producedusing audio output port 110. In the example shown, control inputs 108comprise a “mute track” button 214. When the mute track button isactuated by a user, the audio controller 102 may mute a desired track,while playing of other tracks may continue. In this way, a user maytoggle tracks on/off as desired. In the example shown, control inputs108 comprise a “delete track” button 216. When the delete track buttonis actuated by a user, the audio controller 102 erase a track frommemory 112. In the example shown, control inputs 108 may furthercomprise other control inputs 218 to provide any desired functionality,and/or may not include all of the control inputs 108 depicted in FIG. 2.Although a specific combination of control inputs is described abovewith reference to FIG. 2, any suitable combination of control inputs 108may be provided.

Referring back to FIG. 1A, audio controller 102 may further comprisevisual output unit 116. Visual output unit 116 may be configured toprovide visual outputs in any suitable way. For example, visual outputunit 116 may comprise an array of light emitting elements, such as lightemitting diodes (LEDs), a display, such as a liquid crystal display(LCD), and/or any other suitable visual output component(s). In someembodiments, visual output unit 116 may light up in response toactuation of a button of control inputs 108, and/or in response to anyother suitable form(s) of input. For example, visual output unit 116 maylight up when a track is being recorded, or when the audio controllerdetects audio above a certain threshold. In some embodiments, visualoutput unit 116 may change lighting color in response to certain inputbeing received. For example, a light-emitting element may be associatedwith a track, and may display one color when the track is being recordedand another color when the recording is paused. The visual output unit116 may be used to provide any of numerous different types of visualfeedback to the user. Of course, visual output unit 116 need not relyupon light or color to convey such information.

Audio controller 102 may further comprise transceiver (TX/RX) 114.Transceiver 114 may be a wireless transceiver in some embodiments, andmay be configured to transmit and/or receive data to/from a mobiledevice, such as mobile device 152. Transceiver 114 may be configured totransmit/receive data using any suitable wireless communicationprotocol, whether now known or later developed, including but notlimited to Wi-Fi, Bluetooth, ANT UWB, ZigBee, LTE, GPRS, UMTS, EDGE,HSPA+, WIMAX and Wireless USB. Transceiver 114 may comprise one or moreantennas, such as a strip antenna or a patch antenna, and circuitry formodulating and demodulating signals. Audio controller 102 may furthercomprise a power unit 118. The power unit 118 may power some or all thecomponents of audio controller 102, and may comprise one or morebatteries.

FIG. 1B illustrates mobile device 152, according to some non-limitingembodiments. Mobile device 152 may comprise any suitable device(s),whether now known or later developed, including but not limited to asmartphone, a tablet, a smart watch or other wearable device, a laptop,a gaming device, a desktop computer, etc. In the example shown, mobiledevice 152 comprises transceiver (TX/RX) 164, processor 156, memory 162,audio input port 154, amplifier 159, audio output port 160, controlinputs 158 and display 166. However, it should be appreciated thatmobile device 152 may include any suitable collection of components,which may or may not include all of the components shown, Transceiver164 may be configured to support any of the wireless protocols describedin connection with transceiver 114, and/or other protocols. In someembodiments, transceiver 164 may receive signals, from transceiver 114,that are representative of audio inputs. The received signals may beprocessed in any suitable way using processor 156, and may be stored inmemory 162. Control inputs 158 may comprise any suitable combinations ofthe inputs described in connection with FIG. 2. The inputs may beactuated using a touch screen display. Audio input port 154 may beconnected to an audio source, such as a microphone or an instrument. Themicrophone may be integrated with the mobile device, and/or may beexternal. Audio output port 160 may be connected to a sound emittingdevice, such a speaker set or a headphone set. The speaker set may beembedded in the mobile device. Audio output port 160 may be used to playaudio recordings obtained through audio input ports 1041, 1042 . . .104N or audio input port 154. In some embodiments, amplifier 159 may beused to set the audio output to a desired level. Display 166 may be usedto display waveforms representative of recording audio inputs.

Audio controller 102 and mobile device 152 may communicate via theirrespective transceivers. In the preferred embodiment, audio controller102 and mobile device 152 are configured to communicate wirelessly, butit should be appreciated that a wired connection may be used, inaddition to or as an alternative to a wireless connection.

In the example shown in FIG. 3, audio controller 102 and mobile device152 communicate via communication network(s) 300. The communicationnetwork(s) 300 may employ any suitable communications infrastructureand/or protocol(s). For example, communication network 300 may comprisea Wi-Fi network, Bluetooth network, the Internet, any other suitablenetwork(s), or any suitable combination thereof.

III. Mitigating Communication Delays to Provide a Visual Representationof Recorded Audio

The Assignee has appreciated that the performance of communicationnetwork(s) 300 may be affected by the distance between transceivers 114and 164, any noise or interference present in the environment in whichcommunication network(s) 300 operates, and/or other factors. Forexample, in some circumstances, communication network 300 may notprovide sufficient bandwidth for all communication needs, imposing anupper limit on the rate at which data can be transferred between audiocontroller 102 and mobile device 152. Accordingly, one aspect of thepresent invention relates to the manner in which data is communicatedbetween audio controller 102 and mobile device 152.

In accordance with some embodiments of the invention, a plurality ofdata sequences may be communicated between audio controller 102 andmobile device 152. For example, in some embodiments audio controller 102may transmit, for a body of captured audio input, a low-resolution (LR)sequence and a high-resolution (HR) sequence representing the body ofcaptured audio input to mobile device 152. While both the LR and HRsequence may be representative of the body of audio input capturedthrough audio input ports 104 ₁, 104 ₂ . . . 104 _(N), the way in whichthe sequences are generated and transmitted to mobile device 152 maydiffer. FIG. 4A is a block diagram illustrating how the sequences may begenerated, according to some non-limiting embodiments of the invention.

In the example shown in FIG. 4A, the LR sequence is generated bysampling a body of audio input using sample generator 406 at a firstsampling rate. Sample generator 406 may be implemented using processor106 (FIG. 1A). The first sampling rate may be at any suitable frequency(e.g., between 10 Hz and 1 KHz, between 10 Hz and 100 Hz, between 10 Hzand 50 Hz, between 10 Hz and 30 Hz, between 10 Hz and 20 Hz, or between20 Hz and 30 Hz). The LR sequence may be transmitted to mobile device152 using transceiver 114. In some embodiments, the LR sequence mayinclude data which is used to render a visual representation of capturedaudio to a user of the mobile device, and so the sampling rate may bechosen so the visual representation may be rendered in real time or nearreal time. As used herein, the term “near real time” indicates a delayof 50 ms or less, 30 ms or less, 20 ms or less, 10 ms or less, or 5 msor less.

By contrast, an HR sequence may be generated by sampling the body ofaudio input with sample generator 402, which may also be implementedusing processor 106 (FIG. 1A). The sample generator may, for example,sample the body of audio input at a second sampling rate which isgreater than the first sampling rate. The second sampling rate may beconfigurable, and selected to provide a high-quality digitized versionof the audio input. For example, the second sampling rate may be between1 KHz and 100 KHz, between 1 KHz and 50 KHz, between 1 KHz and 20 KHz,between 10 KHz and 50 KHz, between 10 KHz and 30 KHz, between 10 KHz and20 KHz, or within any suitable range within such ranges.

The body of audio input that is sampled to produce the LR and the HRsequences may be delimited in any suitable way. For example, it may betime-delimited (e.g., representing an amount of audio captured by theaudio controller over an amount of time), data-delimited (e.g.,representing captured audio comprising an amount of data), and/ordelimited in any other suitable fashion.

In some embodiments, the HR sequence may be temporarily stored prior totransmission in a buffer 404, which may be implemented using memory 112,a virtual data buffer, and/or any other suitable storage mechanism(s).In this respect, the Assignee has appreciated that due to the rate atwhich audio input is sampled to produce an HR sequence, the amount ofbandwidth needed to transmit the data in the HR sequence may exceed theavailable bandwidth of communication network(s) 300. By temporarilystoring HR sequence data in buffer 404 prior to transmission, someembodiments of the invention may throttle transmissions acrosscommunication network(s) 300, so that sufficient bandwidth is availableto transmit LR sequence data on a timely basis. That is, through the useof buffer 404, HR sequences may be segmented into bursts fortransmission. In some embodiments, first-in first-out (FIFO) schemes maybe used, that is, data is output out of the buffer 404 in the order itis received. However, it should be appreciated that other schemes mayalso, or alternatively, be used.

In some embodiments, HR sequence data may be held in buffer 404 until itis determined that the buffer stores a predetermined amount of data(e.g., 1 KB, 16 KB, 32 KB, 128 KB, 512 KB, 1 MB, 16 MB, 32 MB, 128 MB,512 MB or any suitable value between such values), or when the amount ofmemory allocated to the buffer is completely populated. The amount ofmemory allocated to buffer 404 may be fixed or variable. If variable,the size may be varied to accomplish any of numerous objectives.

Of course, the invention is not limited to transmitting HR sequence datawhen the buffer stores a predetermined amount of data. For example, insome embodiments, HR sequence data may be transmitted when it isdetermined that communication network(s) 300 have enough bandwidth tosupport transmission of HR sequence data. In some embodiments, HRsequence data may be transmitted when a “stop recording” command isreceived at the audio controller. Any suitable technique(s) may be used,as the invention is not limited in this respect.

FIG. 4B depicts the transmission of LR and the HR sequence data viacommunication network(s) 300. In particular, exemplary LR sequences 420and HR sequences 410 are shown. In the example depicted, multiplediscrete LR sequences are transmitted serially during the time perioddepicted, and thus are depicted as a continuous transmission 420 in FIG.4B for simplicity. Of course, it should be appreciated thattransmissions of LR sequence data may not be performed serially, andthat transmissions may be separated by any suitable time interval(s). Itshould also be appreciated that although FIG. 4B depicts LR sequencesbeing transmitted from the time when recording begins (or shortlythereafter) to the time when recording stops (or shortly thereafter),the invention is not limited to being implemented in this manner, astransmission may start and end at any suitable point(s) in time.Transmission of LR sequences may be performed using any suitabletechnique(s), including but not limited to ZeroMQ.

In the example shown in FIG. 4B, transmission of HR sequences 410 isperformed in multiple bursts, designated 412 ₁, 412 ₂ . . . 412 _(N).Some or all the bursts may, for example, be transmitted after recordingof audio by the audio controller ends.

FIG. 5A depicts a representative method 500 for transmitting audio inputto a mobile device, according to some embodiments of the invention.Method 500 begins at 502. In act 504, a body of audio input is receivedusing an audio controller. The audio controller may receive the body ofaudio input, for example, through one or more audio input ports.

Method 500 then proceeds to act 506, wherein the audio input isprocessed, in any suitable way. For example, the audio input may befiltered, equalized, distorted, etc. Then, in act 508, one or more LRsequences are created based on the audio input. Each LR sequence may begenerated by sampling the audio input(s) at a first sampling rate. Insome embodiments, the LR sequence(s) may be compressed, using anysuitable compression technique(s) and compression ratio(s) (e.g., 2:1,4:1, 16:1, 32:1, or within any range between such values). For example,a free lossless audio codec (FLAC) format for compressing the LRsequence(s) may be used. Each LR sequence is then transmitted to amobile device in act 510. In some embodiments, such transmission iswireless.

In act 512, one or more HR sequences are created by sampling the audioinput(s) at a second sampling rate which is greater than the firstsampling rate. As with the LR sequence(s), each HR sequence may becompressed, using any suitable compression technique (e.g., FLAC) and/orcompression ratio(s). In act 514, the HR sequences are loaded into abuffer.

In act 516, the amount of data in the buffer is determined, and themethod then proceeds to act 518, wherein a determination is made whetherthe amount of data stored in the buffer exceeds a predefined amount ofdata. If it is determined in the act 518 that the amount of data storedin the buffer does not exceed a predefine amount of data, then method500 returns to 516 and proceeds as described above.

However, if it is determined in act 518 that the amount of data storedin the buffer exceeds a predefined amount of data, then method 500proceeds to act 520, wherein the data comprising one or more HRsequences is transmitted to the mobile device.

HR sequence data may be transmitted in any suitable fashion. Forexample, as noted above, in some embodiments HR sequence data may betransmitted in bursts. That is, HR sequence data may be partitioned intomultiple segments, and each segment may be transmitted to the mobiledevice at a different time.

The partitioning of HR sequence data may be accomplished in any ofnumerous ways. As one example, a burst may be transmitted when thebuffer stores a predefined amount of data. As another example, a burstmay be transmitted after an amount of time passes after HR sequence datawas first loaded to the buffer (e.g., less than 1 ms, less than 10 ms,less than 100 ms, less than 1 s, or less than 10 s after HR sequencedata is first loaded to the buffer).

The size of HR sequence data bursts may be fixed or variable. Ifvariable, the size may be chosen depending on any suitable factor(s),such as a comparison between the rate at which HR sequence data isloaded to the buffer and the rate at which HR sequence data istransmitted.

The bursts may, for example, be transmitted one at a time. That is, afirst burst may be transmitted during a first time interval, and asecond burst may be transmitted during a second time interval differentfrom the first time interval. The first and second time intervals may beseparated by any suitable amount of time or may be contiguous. Ofcourse, the invention is not limited to such an implementation, asbursts may be transmitted simultaneously, or during overlapping timeintervals.

In some embodiments, processor 106 may create each burst to include apayload and one or more fields describing the content of the burst. Thepayload may include data which represents a body of captured audioinput. The field(s) may, for example, indicate that the burst includesHR sequence data, the placement of the burst among other HR sequencedata, and/or other information. The field(s) may, for example, beappended to the payload (e.g., as a header).

Act 520 may, in some embodiments, include deleting transmitted data fromthe buffer.

Process 500 then proceeds to act 522, wherein a determination is madewhether a stop recording command has been received. If it is determinedthat a stop recording command has not been received, then method 500returns to act 504, and proceeds to process additional audio input asdescribed above. If, however, it is determined that a stop recordingcommand has been received, then method 500 completes.

It should be appreciated that although representative process 500includes generating an LR sequence and an HR sequence from the same bodyof audio input, the invention is not limited to such an implementation.Each LR sequence and HR sequence may represent any suitable portion(s)of captured audio input.

It should also be appreciated that any of numerous variations on method500 may be employed. For example, some variations may not include all ofthe acts described above, some may include acts not described above, andsome may involve acts being performed in a different sequence than thatwhich is described above. It should further be appreciated that in someembodiments, certain of the acts described above may be performed inparallel, rather than serially as described above. For example, acts 508and 510 may be performed to create and transmit one or more LR sequencesfrom a body of audio input as acts 512-520 are performed to create andtransmit one or more HR sequences from the same body of audio input.

FIG. 5B depicts a representative method 550, which a mobile device mayperform to receive audio input(s). Method 550 begins at 552. In act 554,the mobile device receives data transmitted by an audio controller viaone or more communication networks. In the act 556, a determination ismade whether the received data comprises LR sequence data or HR sequencedata. This determination may be made in any of numerous ways. Forexample, the received data may include a header or field(s) comprisinginformation indicating what type of data it represents.

If it is determined in the act 556 that the data received comprises LRsequence data, process 550 proceeds to act 558, wherein the LR sequencedata is processed by the mobile device, such as to render arepresentation of captured audio input on display 166. Therepresentation may, for example, provide visual feedback on one or morecharacteristics of the audio input to the user of the mobile device.

If it is determined in the act 556 that the data received in the act 554comprises HR sequence data, then process 550 proceeds to act 560,wherein the HR sequence data is stored in a memory of the mobile device.

At the completion of either of act 558 or 560, process 550 proceeds toact 562, wherein a determination is made whether recording of audioinput by the audio controller has stopped. This determination may bemade in any of numerous ways. For example, the audio controller mayprovide to the mobile device an explicit indication that recording hasceased.

If it is determined in the act 562 that recording has not stopped, thenprocess 550 returns to act 554, and repeats as described above. If it isdetermined in the act 562 that recording has stopped, then process 550completes, as indicated at 564.

A representation of captured audio input produced by a mobile devicebased upon LR sequence data may take any of numerous forms. As but oneexample, a representation may comprise a waveform. Such a waveform may,for example, indicate the gain level, and/or any other suitablecharacteristic(s), of the captured audio input. By viewing a renderedrepresentation, the user may determine whether captured audio has any ofnumerous desired characteristics, and thus that audio is captured andrecorded in the manner desired and expected.

FIG. 6A is a schematic diagram of a mobile device during reception of LRsequence data. In the example shown, LR sequence data 420 is receivedusing transceiver 164 and processed using processor 156. In someembodiments, processor 156 may generate a representation of audio inputbased upon LR sequence data 420 for rendering on display 166. Forexample, processor 156 may execute one or more instructions for mappingsamples included in the LR sequence data to corresponding locations onthe display of the mobile device. The locations may, for example,correspond to the gain level reflected in different LR sequences. Forexample, a gain level for a LR sequence may be reflected as a locationalong an axis included in a coordinate system shown on the display(e.g., a vertical axis), such that the higher the gain level, the higherthe location on the axis. As LR sequences representing consecutiveportions of the audio input are processed, the result is a waveformrepresentation of the captured audio input's gain level.

FIG. 6B illustrates an example of a waveform. In particular, waveform670 is displayed on display 666 of mobile device 652. (In the exampleshown, display 666 serves as display 166, and mobile device 652 servesas mobile device 152.) Waveform 670 provides a real time (or near realtime) visual representation of the gain level of captured audio input.Of course, it should be appreciated that more than one waveform may berendered on the display of the mobile device, with each waveformrepresenting a different characteristic of captured audio, each waveformrepresenting different audio inputs (e.g., different tracks of arecording), and/or any other suitable information.

It should also be appreciated that the invention is not limited toemploying one or more waveforms to represent characteristics of capturedaudio, as any suitable representation(s) may be used. As but oneexample, a meter may be used to represent the gain level (and/or anyother suitable characteristic(s)) of captured audio. The invention isnot limited to using any particular type(s) of representation.

As noted above, HR sequence data comprising a digitized version ofcaptured audio may be received by a mobile device, such as during thesame time period as LR sequence data is received. In some embodiments,as HR sequence data is received, it may be stored in a memory of themobile device, to accommodate subsequent playback and/or processing.FIG. 6C is a schematic diagram of a mobile device during reception of HRsequence data 412 ₁-412 _(n). In some embodiments, if HR sequence datais received in a different order than the order in which it wastransmitted, processor 164 may re-order the sequences so as to recomposethe audio input. For example, processor 164 may execute a sortingroutine to sort the received data. This may be performed in any ofnumerous ways, such as by using a value (e.g., provided in a header)indicating a sequence's placement among other sequences. The recomposedaudio input may be stored in memory 162.

In some embodiments, the mobile device may play back captured audio onceit is received from the audio controller in its entirety. For example,mobile device 152 (FIG. 1B) may reproduce received audio using audiooutput port 160, such as in response to user commands.

In some embodiments, the received audio may be processed by a user, inany of numerous ways, such as to produce a desired acoustic effect. Forexample, the user may perform filtering, equalization, amplification,and/or noise compensation on received audio. A software applicationinstalled on the mobile device may provide functionality for processingreceived audio, and a user interface for accessing the functionality.The user interface may, for example, include a waveform panel fordisplaying waveforms representing captured audio.

FIG. 7A-7B illustrate schematically a waveform panel 700 in a “recordmode” and in a “play mode”, respectively. In the record mode, thewaveform panel may be configured to display a waveform corresponding tocaptured audio, as the audio input is being recorded. In the exampleshown in FIG. 7A, a waveform 704 is displayed. Progress bar 706indicates the time elapsed since the beginning of the recording. In someembodiments the software application installed on the mobile device mayautomatically scale the waveform along the horizontal axis, so as todisplay the entirety of the body of captured audio in the waveform panel

FIG. 7B illustrates the waveform panel 700 in the play mode. In theillustrated example, waveform 714 represents a previously recorded audioinput. As the waveform is displayed, the mobile device maysimultaneously play the previously recorded audio input using audiooutput port 160. Progress bar 716 indicates the time elapsed since thebeginning of the audio input. Pause button 722 may be used to pause theplay session. Record button 720 may be used to switch to the recordmode.

IV. User Controls

A. Gain and Pan Adjustment

According to another aspect of the present invention, the softwareapplication may enable a user to set the gain and pan for capturedaudio, such as for each track in a multi-track recording. As notedabove, the gain level for captured audio generally characterizes thepower level of a signal representing the audio as compared to apredetermined level, and the pan level for captured audio generallycharacterizes the amount of a signal representing the audio that is sentto each of multiple (e.g., left and right) channels. By adjusting thegain and the pan for each track in a multi-track recording, a user mayacoustically create the illusion that the sound captured in each trackwas produced from a different physical location relative to thelistener. For example, a user may create the illusion that a guitar inone track is being played close to the listener and on the listener'sright hand side. To do so, the user may increase the gain level (therebyindicating to the listener that the guitar is close by) and set the panto the listener's right hand side The user may also create the illusionthat a bass guitar in another track is being played farther away fromthe listener and on the listener's left hand side. To do so, the usermay decrease the gain (thereby indicating to the user that the bassguitar is further away than the guitar) and set the pan to thelistener's left hand side.

In some embodiments, gain and pan settings for individual tracks may beset using a touch panel on a graphical user interface of a mobiledevice. In some embodiments, the touch panel may represent gain and panlevels for each track on an X-Y coordinate system, with the gain levelrepresented on one of the X-axis and the Y-axis, and the pan levelrepresented on the other of the X-axis and the Y-axis. By moving acursor up and down and left and right within the coordinate systemshown, the user may adjust the gain and the pan for a track. FIG. 8Aillustrates an example. Mobile device 852, which may serve as mobiledevice 152, may be configured to render touch panel 830. In someembodiments, the touch panel 830 may render an X-Y coordinate system.The touch panel may display one or more gain/pan cursors, which in thenon-limiting example shown in FIG. 8A are labeled “1”, “2”, “3”, “4”,“5”, “6”, “7”, and “8”. In the example shown, the gain/pan cursors aredisplayed as circles. However, it should be appreciated that any othersuitable shape may be used for the gain/pan cursors. Each gain/pancursor may be associated with a track, and may represent a point withinthe gain/pan coordinate system. For each recorded track, a user mayenter a desired gain/pan combination by moving the correspondinggain/pan cursor within the touch panel. For example, the user may touch,with a finger, an area of the touch panel that includes a gain/pancursor, and move the gain/pan cursor up/down and/or left/right. In theexample shown, moving a gain/pan cursor up/down along the Y-axis causesan increase/decrease in the gain of the corresponding track, whilemoving a gain/pan cursor left/right along the X-axis causes the pan ofthe track to be shifted toward the left/right channel. It should beappreciated that gain and pan may be adjusted by moving a gain/pancursor in other ways.

While FIG. 8A illustrates a method for entering a gain/pan combinationusing a touch panel, the application is not limited in this respect andother methods may be used. For example, a gain/pan combination may beselected by entering values in a table, by vocally instructing asoftware application, or by using a control device (e.g., a mouse orkeyboard). A table stored in memory 162 may keep track of the gain/pancursors selected by the user. FIG. 8B illustrates an example of such atable. For each track 1 . . . 8, the table includes a first valuerepresenting the selected gain and a second value representing theselected pan. The values illustrated in the table are expressed inarbitrary unit, but any suitable unit may be used. The selected valuesmay be used to control the manner in which the recorded tracks areplayed. The gain value may be used to set the gain of an amplifier, andthe pan value may be used to set the balance between the audio channels.In some embodiments, a stereo sound system may be used. An example of astereo sound system is illustrated in FIG. 8C. In the example shown, thestereo sound system 800 comprises a control unit 820, amplifiers 822 and824, and sound emitting devices 826 and 828 (labeled “L” and “R” forleft and right). However, it should be appreciated that differentconfigurations may be used. For example, more than two channels may beused. The control unit 820 may be implemented using processor 106 orprocessor 156. Amplifiers 822 and 824 may be implemented using amplifier109 or amplifier 159. The sound emitting devices 826 and 828 may beconnected to the amplifier via audio output port 110 or audio outputport 160. For each track, based on the selected gain/pan values, controlunit 820 may set the gain of the amplifiers 822 and 824. For example,the sum (or the product) of the gains of amplifiers 822 and 824 may bebased on the gain value, and the ratio (or the difference) of the gainsof amplifiers 822 and 824 may be based on the pan value. However, othermethods may be used.

FIG. 8D is a flowchart illustrating a representative method 801 foradjusting gain and pan for a track, according to some non-limitingembodiments. Method 801 begins at 802. In act 804, a first valueindicative of a user's preference with respect to a track's volume isreceived. In some embodiments, the first value may be entered by a userby moving a single cursor representing both gain and pan “up” and “down”within a coordinate system depicted in a touch panel. At act 806, asecond value indicative of a user's preference with respect to thetrack's pan may be received. In some embodiments, the second value maybe entered by a user by moving the cursor “left” and “right” within thecoordinate system depicted by the touch panel. At act 808, based on thereceived gain and pan values, the gain of a first amplifier may becontrolled. The first amplifier may be connected to a firstsound-emitting device. At act 810, based on the received gain and panvalues, the gain of a second amplifier may be controlled. The secondamplifier may be connected to a second sound-emitting device. The firstand second sound emitting devices may collectively form a stereo soundsystem. At act 812, it is determined whether additional gain/values arereceived. If no additional values are received, method 801 may end atact 814. If additional values are received, method 801 may repeatanother track.

In some embodiments, the first value and the second value may be enteredby a user using a single input device, such as the user's finger, astylus or any other suitable implement.

B. Sound Check

Sound checks are often performed to make sure that sound is producedclearly and at the right volume. Manual sound checks are performed bysound engineers or musicians by playing a portion of an audio piece andby determining whether the volume of the audio is acceptable. If it isnot, the sound engineer or musician may readjust the level of anamplifier and re-play a portion of an audio piece. If the volume isstill not acceptable, another iteration may be performed. This methodmay be cumbersome, as multiple iterations may be needed before thedesired condition is reached. The Assignee has appreciated that a soundcheck may be performed automatically using an audio recording system ofthe type described herein. In automatic sound checks, gain may beadjusted using electronic circuits as the audio input is being acquired.In this way, the sound check may be performed automatically withouthaving to interrupt the musician's performance. According to one aspectof the present invention, automatic sound checks may be performed usingaudio controller 102 and/or mobile device 152. In some embodiments, asound check may be performed during a dedicated audio recording session,which will be referred to herein as a “sound check routine”, whichtypically takes place before an actual recording session. However, theapplication is not limited in this respect and sound checks may be anactual recording session. In this way, if there are variations in therecording environment (e.g., if a crowd fills the recording venue), orif there are variations in the characteristics of the audio beingrecorded (e.g., a single music piece includes multiple music genres),the recording parameters (e.g., gain) may be adjusted dynamically.

FIG. 9A is a schematic view illustrating a mobile device 901 during asound check routine. Mobile device 901 may serve as mobile device 152.Mobile device 901 may initiate a sound check routine in response toreceiving a user request. In some embodiments, such a request may beentered by a user by initiating a sound check button key, such as soundcheck button 210. In some embodiments, sound check button 210 may bedisposed on the top side of the housing of audio controller 102.Positioning sound button 210 on the top side of the housing may provideeasy reach to the user.

In some embodiments, the sound check routine may comprise a “checkinglevels” phase, in which levels of the audio input are detected; a“detecting silence” phase, in which a silence level is detected; and an“adjusting gain” phase, in which a gain is adjusted. Such routine maytake a few seconds (e.g., less than 30 seconds, less than 20 seconds orless than 10 seconds). FIG. 9B illustrates schematically an audio input900, which may be used during a sound check routine. Audio input 900 maybe received through an audio controller or through an audio input portof the mobile device. In the checking levels phase, one or more levelsof the audio input may be detected by a processor. For example, theaverage level 904 of audio input 900 may be detected between a time t₁and a time t₂. The average level may be computed in any suitable way,including an arithmetic mean, a geometric mean, a root mean square, etc.In some embodiments, a moving average may be computed. Accordingly, theaverage level may be computed during periodic intervals. The durationsof the time intervals may be between 1 second and 100 seconds, between 1second and 50 seconds, between 1 second and 20 seconds, between 1 secondand 10 seconds, between 5 second and 10 seconds, between 10 second and20 seconds, or within any range within such ranges. In this way, if theaudio input varies its characteristics over time, the average level maybe adjusted accordingly.

In some embodiments, a peak level 906, corresponding to the intensity ofa peak 911, may be detected. In the detecting silence phase, a silencelevel 902 may be detected. During this phase, the mobile device mayprompt the user to stop playing. In this way, the mobile device maydetect the level received when no audio is played. The silence level maybe limited by the background noise. In the adjusting gain phase, thegain of an amplifier, such as amplifier 159, may be adjusted based onthe levels detected in the checking levels and the detecting silencephases. The gain may be adjusted so as to allow the audio output to varywithin the dynamic range of the audio output system.

In some circumstances, the dynamic range of the audio system may belimited by the amplifier, while in other circumstances, it may belimited by the sound emitting device. FIG. 9C illustrates output audio960 obtained by amplifying audio input 900. The dynamic range of theaudio output system may be bound by a lower level 918 and by an upperlevel 924. In some embodiments, the dynamic range may be defined as theregion in which the response of the audio output system, which includesamplifier 109 and a sound-emitting device, is linear. In otherembodiments, the dynamic range may be defined as the region in whichharmonic distortion is less than 10%, less than 5%, less than 3%, lessthan 2%, or less than 1%. The gain of the amplifier may be selected suchthat output audio 960 is within the dynamic range of the audio outputsystem. In some embodiments, the silence level of the audio input 900may be set to correspond to the lower level 918 of the dynamic range.

In some embodiments, a “headroom” region may be provided within thedynamic range. The headroom region may provide sufficient room for soundhaving a peak level to be played without creating distortion. Theheadroom region may be confined between upper level 924 and a headroomlevel 922. In some embodiments, headroom level 922 may be set at thelevel of the maximum of the audio input (e.g., level 906). The headroommay occupy any suitable portion of the dynamic range, such as 30% orless, 25% or less, 20% or less, 15% or less, 10% or less, or 5% or less.Choosing the size of the headroom may be based on trade-offconsiderations between providing enough room for peaks and limitingnoise.

The examples of FIGS. 9A-9C illustrate sound check routines performedusing a mobile device. Alternatively, a sound check routine may beperformed using audio controller 102. In this embodiment, processor 106may detect the levels of an audio input received though an audio inputport, and may adjust the gain of amplifier 109. The detection and thegain adjustment may be performed in the manner described in connectionwith FIGS. 9B-9C.

FIG. 9D illustrates a representative method 961 for performing a soundcheck routine, according to some non-limiting embodiments. Method 961begins at 962. In act 963, a request to perform a sound check routine isreceived. A user may request to perform a sound check routine byactuating sound check button 210 on the audio controller 102, or througha user interface on mobile device 152. At act 964, an audio input isreceived and one or more levels of the audio input are detected. Theaudio may be received using an audio input port of audio controller 102or an audio input port of mobile device 152. Detection of the level(s)may be performed using processor 106 or 156. In some embodiments, theaverage level of the audio input may be detected. In some embodiments,the levels of one or more peaks may be detected.

In act 954, a silence level is detected. The silence level may bedetected when no audio input is received. At act 966, the gain of anamplifier, such as amplifier 109 or 159, may be adjusted based on thelevel(s) detected at act 964 and the silence level detected at act 965.The gain is then adjusted in the act 966 so as to allow the audio outputto vary within the dynamic range of the audio output system. In someembodiments, headroom may be provided within the dynamic range. Theheadroom may provide sufficient room for peaks to be played withoutsignificant distortion. Method 961 then completes.

The sound check routines described above are examples of automaticadjustment of the gain level of audio captured by an audio recordingsystem. However, it should be appreciated that other (e.g., manual orsemi-automatic) types of routines may be executed to adjust any ofnumerous audio characteristics.

For example, automatic gain adjustment of multiple amplification stagesmay be provided in some embodiments. In some embodiments, it may bedesirable to amplify an audio input with a first amplifier locatedwithin the audio controller and with a second amplifier located withinthe mobile device. In some embodiments, a user may enter a desiredamplification level, for example using the touchscreen of mobile device152 or by actuating audio output level 212, and in response the gain ofthe amplifier located within the audio controller and the gain of theamplifier located within the mobile device may be set. In this way, asingle entry may allow a user to set multiple gains. In contrast, insome conventional audio systems that include more than one amplificationstage, a user may have to manually adjust the gain of each amplificationuntil the desired audio quality is obtained. This operation may becumbersome as it may take multiple iterations. In some embodiments,however, the user may set the gain of the two amplification stages witha single entry. When the desired gain level is provided by a user,processor 106 and/or processor 156 may adjust the gain of the twoamplification stages to provide a certain sound quality. For example,the processor(s) may automatically adjust such gains until the noiselevel is below a certain value.

In some embodiments, to limit noise, the gain of the first and secondamplifiers may be set to match one another. FIG. 10 shows a blockdiagram illustrating a data path including a plurality of amplificationstages. As illustrated, audio controller 102 may receive an audio inputvia audio input port 1041, may amplify the received signal withamplifier 113, and may transmit the amplified signal to mobile device152 using transceiver 114. The transmitted signal may be received usingtransceiver 164, may be amplified using amplifier 159, and may be playedusing a sound emitting device (not shown in FIG. 10) connected to audiooutput port 160. In some embodiments, the gain of amplifier 113 may beset to be substantially equal (e.g., between 99% and 101%, between 95%and 105%, between 90% and 110%, between 80% and 120%, or between 75% and125%) to the gain of amplifier 159. In this way, noise may be limited.

In another example, a certain characteristic of an audio recordingsystem may be adjusted in response to detecting what type of audiosource has been connected to an audio input port. For example, the audiorecording system may recognize whether a microphone or an instrument hasbeen plugged in, and/or what type of instrument has been plugged in. Anysuitable technique for recognized the type of audio source may be used.For example, recognition of audio sources may be performed using machinelearning techniques. Accordingly, the audio recording system may betrained to recognize certain patterns associated with specific audiosources. Other automatic recognition techniques may alternatively beused. In some embodiments, automatic recognition of an audio source maybe triggered by a user, for example by pressing a button on the audiocontroller 102 (not shown in FIG. 2), or by actuating a key on thetouchscreen of mobile device 152. In response to detecting the type ofaudio source, processor 106 and/or processor 156 may automaticallyadjust the gain of an amplifier. For example, the processor may beconfigured to set a higher gain for guitar or voice recordings, and alower gain for drums or bass recordings.

In yet another example, automatic sound equalization may be performed.In some circumstances, it may be desirable to adjust the frequencycontent of an audio output based on a certain characteristic of theaudio input (e.g., the music genre) and/or the surrounding environment.In some embodiments, when an audio input is received, processor 106and/or processor 156 may analyze the spectral content of the audioinput. For example, the processor(s) may segment the spectrum of theaudio input into sub-bands, and may determine the level of the audioinput within such sub-bands. Based on these levels and on the desiredspectral output, the processor(s) may adjust the spectral content of theaudio input. Adjustment of the spectral content of an audio input may beperformed in any suitable way. For example, a digital filter may beused. The digital filter may be designed to produce a desired spectralcontent (e.g., to equalize) across a bandwidth of interest (e.g.,between 20 HZ and 20 KHz or between any values within such range). Thedigital filter may be configured to attenuate the level of certainsub-bands, and/or amplify the level of other sub-bands. In this way, adesired spectral output may be obtained. In some embodiments, automaticsound equalization may be performed in response to detecting what typeof audio source has been plugged in. The way in which the spectralcontent of the audio input is modified may depend on the type of thedetected audio source.

C. Automatically Creating and Mapping Tracks

The Assignee has appreciated that the process of mapping tracks to audioinputs is often cumbersome. For example, in some circumstances, an audioengineer manually performs multiple steps, including generating an emptytrack in a software application, importing a file containing an audioinput into the software application, and mapping the file to the emptytrack. This method may be cumbersome, as multiple steps may be neededbefore the desired condition is reached.

In some embodiments, the mapping may be automated using a track mappingcontroller. FIG. 11A is a block diagram illustrating a track mappingcontroller. In some embodiments, a plurality of audio inputs may bereceived using the audio input ports of audio controller 102 or theaudio input ports of mobile device 152. For example, audio inputs 1102,1104 and 1106 may be received. The received audio inputs may be providedto track mapping controller 1110, which may be implemented usingprocessor 106 or 156. Track mapping controller 1110 may detect thenumber of audio inputs received, and may automatically create a trackfor each of the audio inputs. Each track may be mapped to acorresponding audio input, and may be stored in a memory. For example,track 1112 may be mapped to audio input 1102, track 1114 may be mappedto audio input 1104, and track 1116 may be mapped to audio input 1106.In some embodiments, the tracks may be rendered on display 166. In theseembodiments, processor 156 may generate, for each track stored in thememory, data for rendering a corresponding waveform in the mannerdescribed above. For example, track 1112 may be mapped to waveform 1122,track 1114 may be mapped to waveform 1124, and track 1116 may be mappedto waveform 1126. The waveforms may be rendered on display 166.

FIG. 11B is a flowchart illustrating a method for mapping audio inputsto tracks. Method 1130 may begin at act 1132. At act 1134, an audioinput may be received. The audio input may be received through an audioinput port. At act, 1136, a track may be created. Creation of a trackmay be performed in any suitable way. For example, creating a track maycomprise allocating dedicated space on a memory device for an audioinput. At act 1138, the track may be mapped to the received audio input.Optionally, at act 1140, a waveform may be generated based on the track,and the waveform may be rendered on a display (e.g., a display of amobile device). At act 1142, it is determined whether additional audioinputs are received. If no additional audio inputs are received themethod ends at act 1144. Otherwise, if an additional audio input isreceived, the method may continue to iterate.

In some embodiments, when a new track is automatically created, theprocessor(s) may be further configured to adjust the gain of anamplifier, such as amplifier 113 and/or amplifier 159. The gain of theamplifier(s) may be performed in response to receiving instructions froma user, or may be performed automatically upon creation of a new track.

In some circumstances, a user may want to pause a recording session.Accordingly, the user may first hit a pause key, such as stop button206, and then hit a resume recording key, such as record button 202, ata later time. In some embodiments, in response to receiving a request tocontinue to record, a new track may be created and the recorded audioinput may be associated with such new track. In other embodiments, inresponse to receiving a request to continue to record, a pre-existingtrack may be used. In these embodiments, audio data may be attached tothe pre-existing track.

V. Implementation Detail

FIG. 12 depicts a general purpose computing device, in the form of acomputer 910, which may be used to implement certain aspects of theinvention. For example, computer 910 or components thereof mayconstitute any of the audio controllers, mobile devices, and/ornetworking components described above.

In computer 910, components include, but are not limited to, aprocessing unit 920, a system memory 930, and a system bus 921 thatcouples various system components including the system memory to theprocessing unit 920. The system bus 921 may be any of several types ofbus structures including a memory bus or memory controller, a peripheralbus, and a local bus using any of a variety of bus architectures. By wayof example, and not limitation, such architectures include IndustryStandard Architecture (ISA) bus, Micro Channel Architecture (MCA) bus,Enhanced ISA (EISA) bus, Video Electronics Standards Association (VESA)local bus, and Peripheral Component Interconnect (PCI) bus also known asMezzanine bus.

Computer 910 typically includes a variety of computer readable media.Computer readable media can be any available media that can be accessedby computer 910 and includes both volatile and nonvolatile media,removable and non-removable media. By way of example, and notlimitation, computer readable media may comprise computer storage mediaand communication media. Computer storage media includes both volatileand nonvolatile, removable and non-removable media implemented in anymethod or technology for storage of information such as computerreadable instructions, data structures, program modules or other data.Computer storage media include, but are not limited to, RAM, ROM,EEPROM, flash memory or other memory technology, CD-ROM, digitalversatile disks (DVD) or other optical disk storage, magnetic cassettes,magnetic tape, magnetic disk storage or other magnetic storage devices,or any other one or more media which may be used to store the desiredinformation and may be accessed by computer 910. Communication mediatypically embody computer readable instructions, data structures,program modules or other data in a modulated data signal such as acarrier wave or other transport mechanism and includes any informationdelivery media. The term “modulated data signal” means a signal that hasone or more of its characteristics set or changed in such a manner as toencode information in the signal. By way of example, and not limitation,communication media include wired media such as a wired network ordirect-wired connection, and wireless media such as acoustic, RF,infrared and other wireless media. Combinations of the any of the aboveshould also be included within the scope of computer readable media.

The system memory 930 includes computer storage media in the form ofvolatile and/or nonvolatile memory such as read only memory (ROM) 931and random access memory (RAM) 932. A basic input/output system 933(BIOS), containing the basic routines that help to transfer informationbetween elements within computer 910, such as during start-up, istypically stored in ROM 931. RAM 932 typically contains data and/orprogram modules that are immediately accessible to and/or presentlybeing operated on by processing unit 920. By way of example, and notlimitation, FIG. 12 illustrates operating system 934, applicationprograms 935, other program modules 939, and program data 937.

The computer 910 may also include other removable/non-removable,volatile/nonvolatile computer storage media. By way of example only,FIG. 12 illustrates a hard disk drive 941 that reads from or writes tonon-removable, nonvolatile magnetic media, a magnetic disk drive 951that reads from or writes to a removable, nonvolatile magnetic disk 952,and an optical disk drive 955 that reads from or writes to a removable,nonvolatile optical disk 959 such as a CD ROM or other optical media.Other removable/non-removable, volatile/nonvolatile computer storagemedia that can be used in the exemplary computing system include, butare not limited to, magnetic tape cassettes, flash memory cards, digitalversatile disks, digital video tape, solid state RAM, solid state ROM,and the like. The hard disk drive 941 is typically connected to thesystem bus 921 through an non-removable memory interface such asinterface 940, and magnetic disk drive 951 and optical disk drive 955are typically connected to the system bus 921 by a removable memoryinterface, such as interface 950.

The drives and their associated computer storage media discussed aboveand illustrated in FIG. 12, provide storage of computer readableinstructions, data structures, program modules and other data for thecomputer 910. In FIG. 12, for example, hard disk drive 941 isillustrated as storing operating system 944, application programs 945,other program modules 949, and program data 947. Note that thesecomponents can either be the same as or different from operating system934, application programs 935, other program modules 539, and programdata 937. Operating system 944, application programs 945, other programmodules 949, and program data 947 are given different numbers here toillustrate that, at a minimum, they are different copies. A user mayenter commands and information into the computer 910 through inputdevices such as a keyboard 992 and pointing device 991, commonlyreferred to as a mouse, trackball or touch pad. Other input devices (notshown) may include a microphone, joystick, game pad, satellite dish,scanner, or the like. These and other input devices are often connectedto the processing unit 920 through a user input interface 590 that iscoupled to the system bus, but may be connected by other interface andbus structures, such as a parallel port, game port or a universal serialbus (USB). A monitor 991 or other type of display device is alsoconnected to the system bus 921 via an interface, such as a videointerface 990. In addition to the monitor, computers may also includeother peripheral output devices such as speakers 997 and printer 999,which may be connected through a output peripheral interface 995.

The computer 910 may operate in a networked environment using logicalconnections to one or more remote computers, such as a remote computer980. The remote computer 980 may be a personal computer, a server, arouter, a network PC, a peer device or other common network node, andtypically includes many or all of the elements described above relativeto the computer 910, although only a memory storage device 981 has beenillustrated in FIG. 12. The logical connections depicted in FIG. 12include a local area network (LAN) 971 and a wide area network (WAN)973, but may also include other networks. Such networking environmentsare commonplace in offices, enterprise-wide computer networks, intranetsand the Internet.

When used in a LAN networking environment, the computer 910 is connectedto the LAN 971 through a network interface or adapter 970. When used ina WAN networking environment, the computer 910 typically includes amodem 972 or other means for establishing communications over the WAN973, such as the Internet. The modem 972, which may be internal orexternal, may be connected to the system bus 921 via the user inputinterface 990, or other appropriate mechanism. In a networkedenvironment, program modules depicted relative to the computer 910, orportions thereof, may be stored in the remote memory storage device. Byway of example, and not limitation, FIG. 12 illustrates remoteapplication programs 985 as residing on memory device 981. It will beappreciated that the network connections shown are exemplary and othermeans of establishing a communications link between the computers may beused.

Embodiments of the invention may be embodied as a computer readablestorage medium (or multiple computer readable media) (e.g., a computermemory, one or more floppy discs, compact discs (CD), optical discs,digital video disks (DVD), magnetic tapes, flash memories, circuitconfigurations in Field Programmable Gate Arrays or other semiconductordevices, or other tangible computer storage medium) encoded with one ormore programs that, when executed on one or more computers or otherprocessors, perform methods that implement the various embodiments ofthe invention discussed above. As is apparent from the foregoingexamples, a computer readable storage medium may retain information fora sufficient time to provide computer-executable instructions in anon-transitory form. Such a computer readable storage medium or mediacan be transportable, such that the program or programs stored thereoncan be loaded onto one or more different computers or other processorsto implement various aspects of the present invention as discussedabove. As used herein, the term “computer-readable storage medium”encompasses only a tangible machine, mechanism or device from which acomputer may read information. Alternatively or additionally, theinvention may be embodied as a computer readable medium other than acomputer-readable storage medium. Examples of computer readable mediawhich are not computer readable storage media include transitory media,like propagating signals.

Having thus described several aspects of at least one embodiment of thisinvention, it is to be appreciated that various alterations,modifications, and improvements will readily occur to those skilled inthe art. Such alterations, modifications, and improvements are intendedto be part of this disclosure, and are intended to be within the spiritand scope of the invention. Further, though advantages of the presentinvention are indicated, it should be appreciated that not everyembodiment of the invention will include every described advantage. Someembodiments may not implement any features described as advantageousherein and in some instances. Accordingly, the foregoing description anddrawings are by way of example only.

Various aspects of the present invention may be used alone, incombination, or in a variety of arrangements not specifically discussedin the embodiments described in the foregoing, and it is, therefore, notlimited in its application to the details and arrangement of componentsset forth in the foregoing description or illustrated in the drawings.For example, aspects described in one embodiment may be combined in anymanner with aspects described in other embodiments.

The invention may be embodied as a method, of which various exampleshave been described. The acts performed as part of the method may beordered in any suitable way. Accordingly, embodiments may be constructedin which acts are performed in an order different than illustrated,which may include different (e.g., more or less) acts than those whichare described, and/or which may involve performing some actssimultaneously, even though the acts are shown as being performedsequentially in the embodiments specifically described above.

Use of ordinal terms such as “first,” “second,” “third,” etc., in theclaims to modify a claim element does not by itself connote anypriority, precedence, or order of one claim element over another or thetemporal order in which acts of a method are performed, but are usedmerely as labels to distinguish one claim element having a certain namefrom another element having the same name (but for use of the ordinalterm) to distinguish the claim elements.

Also, the phraseology and terminology used herein is for the purpose ofdescription and should not be regarded as limiting. The use of“including,” “comprising,” or “having,” “containing,” “involving,” andvariations thereof herein, is meant to encompass the items listedthereafter and equivalents thereof as well as additional items.

The invention claimed is:
 1. A method for use in relation to an audiocontroller comprising at least one processor, at least one antenna andmemory, the method comprising acts of: (A) receiving, by the audiocontroller, audio input; (B) generating, by the audio controller usingthe at least one processor, first and second data from the audio input,the first data being usable to create a visual representation of theaudio input, the second data comprising a digital representation of theaudio input; (C) during a first time period: transmitting, by the audiocontroller using the at least one antenna, the first data, via at leastone wireless network, to a device; and storing, by the audio controller,the second data in memory; and (D) during a second time period followingthe first time period, transmitting, by the audio controller using theat least one antenna, the second data, via the at least one wirelessnetwork, to the device; wherein: the audio input comprises first andsecond portions, received sequentially by the audio controller; the act(C) comprises transmitting the first data generated using the first andsecond portions to the device, and storing the second data generatedusing the first and second portions to memory, during the first timeperiod; and the act (D) comprises transmitting the second data generatedusing the first and second portions to the device during the second timeperiod following the first time period.
 2. The method of claim 1,wherein the act (C) comprises transmitting the first data generatedusing the first and second portions to the device substantially in realtime.
 3. The method of claim 1, wherein the act (A) comprises the audiocontroller receiving the audio input via at least one of an audio inputport and a microphone.
 4. The method of claim 1, wherein the audio inputis received from a musical instrument.
 5. The method of claim 1, whereinthe act (B) comprises the audio controller generating the first data soas to comprise information usable to create a waveform representation ofthe audio input.
 6. The method of claim 1, wherein the act (B) comprisesthe audio controller filtering, equalizing, amplifying and/orattenuating one or more spectral components of the audio input ingenerating the second data.
 7. The method of claim 1, wherein the act(B) comprises the audio controller generating the first data by samplingthe audio input at a first sampling rate, and generating the second databy sampling the audio input at a second sampling rate that is greaterthan the first sampling rate.
 8. The method of claim 1, wherein the acts(A), (B) and (C) are performed in immediate succession.
 9. The method ofclaim 1, wherein the act (B) comprises the audio controller compressingthe first data, and the act (C) comprises the audio controllertransmitting the compressed first data to the device.
 10. The method ofclaim 1, wherein the second time period commences upon a determinationby the audio controller that a predetermined amount of time has passedsince the second data was stored in memory.
 11. The method of claim 1,wherein the second time period commences upon a determination by theaudio controller that the at least one wireless network has sufficientbandwidth to transmit the stored second data to the device.
 12. A methodfor use in relation to an audio controller comprising at least oneprocessor, at least one antenna, and memory, the method comprising actsof: (A) receiving, by the audio controller, audio input; (B) generating,by the audio controller using the at least one processor, first andsecond data from the audio input, the first data being usable to createa visual representation of the audio input, the second data comprising adigital representation of the audio input; (C) during a first timeperiod: transmitting, by the audio controller using the at least oneantenna, the first data, via at least one wireless network, to a device;and storing, by the audio controller, the second data in memory; and (D)during a second time period following the first time period,transmitting, by the audio controller using the at least one antenna,the second data, via the at least one wireless network, to the device;wherein: the audio controller comprises a user interface; the secondtime period commences upon a determination by the audio controller thata predetermined input has been received via the user interface; and thepredetermined input indicates that the audio controller is to stoprecording audio input.
 13. The method of claim 12, wherein the act (A)comprises the audio controller receiving the audio input via at leastone of an audio input port and a microphone.
 14. The method of claim 12,wherein the audio input is received from a musical instrument.
 15. Themethod of claim 12, wherein the act (B) comprises the audio controllergenerating the first data so as to comprise information usable to createa waveform representation of the audio input.
 16. The method of claim12, wherein the act (B) comprises the audio controller filtering,equalizing, amplifying and/or attenuating one or more spectralcomponents of the audio input in generating the second data.
 17. Themethod of claim 12, wherein the act (B) comprises the audio controllergenerating the first data by sampling the audio input at a firstsampling rate, and generating the second data by sampling the audioinput at a second sampling rate that is greater than the first samplingrate.
 18. The method of claim 12, wherein the acts (A), (B) and (C) areperformed in immediate succession.
 19. The method of claim 12, whereinthe act (B) comprises the audio controller compressing the first data,and the act (C) comprises the audio controller transmitting thecompressed first data to the device.
 20. An audio controller,comprising: at least one antenna; at least one computer-readable storagemedium having instructions encoded thereon; and at least one computerprocessor, operatively coupled to the at least one antenna, the at leastone computer processor being programmed via the instructions to: receiveaudio input; generate first and second data from the audio input, thefirst data being usable to create a visual representation of the audioinput, the second data comprising a digital representation of the audioinput; during a first time period: transmit the first data, via at leastone wireless network, to a device; and store the second data in the atleast one computer-readable storage medium; and during a second timeperiod following the first time period, transmit, using the at least oneantenna, the second data, via the at least one wireless network, to thedevice; wherein: the audio input comprises first and second portions,received sequentially by the audio controller; the at least one computerprocessor is programmed via the instructions to, during the first timeperiod, transmit the first data generated using the first and secondportions to the device, and store the second data generated using thefirst and second portions to the at least one computer-readable storagemedium; and the at least one computer processor is programmed via theinstructions to, during the second time period, transmit the second datagenerated using the first and second portions to the device.
 21. Theaudio controller of claim 20, wherein the at least one computerprocessor is programmed via the instructions to transmit the first datagenerated using the first and second portions to the devicesubstantially in real time.
 22. The audio controller of claim 20,comprising at least one of an audio input port and a microphone forreceiving the audio input.
 23. The audio controller of claim 20,configured to receive the audio input from a musical instrument.
 24. Theaudio controller of claim 20, wherein the at least one computerprocessor is programmed via the instructions to generate the first dataso as to comprise information usable to create a waveform representationof the audio input.
 25. The audio controller of claim 20, wherein the atleast one computer processor is programmed via the instructions tofilter, equalize, amplify and/or attenuate one or more spectralcomponents of the audio input in generating the second data.
 26. Theaudio controller of claim 20, wherein the at least one computerprocessor is programmed via the instructions to generate the first databy sampling the audio input at a first sampling rate, and to generatethe second data by sampling the audio input at a second sampling ratethat is greater than the first sampling rate.
 27. The audio controllerof claim 20, wherein the at least one computer processor is programmedvia the instructions to receive the audio input, generate the first andsecond data, transmit the first data to the device, and store the seconddata in immediate succession.
 28. The audio controller of claim 20,wherein the at least one computer processor is programmed via theinstructions to compress the first data, and to transmit the compressedfirst data to the device.
 29. The audio controller of claim 20,configured so that the second time period commences upon a determinationby the at least one computer processor that a predetermined amount oftime has passed since the second data was stored in memory.
 30. Theaudio controller of claim 20, configured so that the second time periodcommences upon a determination by the at least one computer processorthat the at least one wireless network has sufficient bandwidth totransmit the stored second data to the device.
 31. An audio controller,comprising: at least one antenna; at least one computer-readable storagemedium having instructions encoded thereon; and at least one computerprocessor, operatively coupled to the at least one antenna, the at leastone computer processor being programmed via the instructions to: receiveaudio input; generate first and second data from the audio input, thefirst data being usable to create a visual representation of the audioinput, the second data comprising a digital representation of the audioinput; during a first time period: transmit, using the at least oneantenna, the first data, via at least one wireless network, to a device;and store the second data in the at least one computer-readable storagemedium; and during a second time period following the first time period,transmit, using the at least one antenna, the second data, via the atleast one wireless network, to the device; wherein: the audio controllercomprises a user interface; the at least one computer processor isprogrammed via the instructions to commence the second time period upona determination that a predetermined input has been received via theuser interface; and the predetermined input indicates that the audiocontroller is to stop recording audio input.
 32. The audio controller ofclaim 31, comprising at least one of an audio input port and amicrophone for receiving the audio input.
 33. The audio controller ofclaim 31, configured to receive the audio input from a musicalinstrument.
 34. The audio controller of claim 31, wherein the at leastone computer processor is programmed via the instructions to generatethe first data so as to comprise information usable to create a waveformrepresentation of the audio input.
 35. The audio controller of claim 31,wherein the at least one computer processor is programmed via theinstructions to filter, equalize, amplify and/or attenuate one or morespectral components of the audio input in generating the second data.36. The audio controller of claim 31, wherein the at least one computerprocessor is programmed via the instructions to generate the first databy sampling the audio input at a first sampling rate, and generate thesecond data by sampling the audio input at a second sampling rate thatis greater than the first sampling rate.
 37. The audio controller ofclaim 31, wherein the at least one computer processor is programmed viathe instructions to receive the audio input, generate the first andsecond data, transmit the first data to the device, and store the seconddata in immediate succession.
 38. The audio controller of claim 31,wherein the act (B) comprises the audio controller compressing the firstdata, and the act (C) comprises the audio controller transmitting thecompressed first data to the device.